DOCDHEHf BlSaHE 



ED 137 378 IM 006 183 

AUIHOB CarrolliP C, Dennisr McKeown^ Bobin J* 

TITLE ^IKOVA ior Longituainal Designs with Multiple 

Dapendant Variablea. 
PDB DlTl £lpr 77] 

NOTE 22p,| Paper praaented at the iJinuai Meeting of th^ 

. Iserican Educational lesaarch Association (61at^ Hew 
York, New YorJc, April 4-8, 1977) 

EDBS PSICE MP--$0,83 HC-$n67 Plus Postage, 

DESCBIPIOfiS *lnalyaia of Variance; Hypothesis lasting; 

^longitudinal Studies; ^^Statistical Inalyais; 

Statistical Bias; lasts of Significance 
IDENTIFIEHS *Multi¥ariate Analysis of Variance 

ABSTBACT 

The application of a multivariate analytic technigua 
for the analysis of data from longitudinal designs Mith multiple 
dependent variables is presented. The tachnigue is the multivariate 
generalization of univariate repeated measures AHOVA. An application 
of the technigue to data collected using materials from the Asian 
Studies Curriculum Pro ject is included. The example analysis 
indicated the technigue is viable and should he a useful tool for tha 
methodologist/evaluator, (Author) 



* Dbcumants acquired by EEIC include many informal unpublished * 

* materials not available from other sources, EEIC makes every effort * 

* to obtain the best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of the microfiche and hardcopy reproductions EEIC makes available * 

^ via the EBIC Documen^i Reproduction Service (EDIS) • EDRS is not * ' 

* responsible for the quality of the original document. Beproductions * 

* supplied by EDES are the beat that can be made from the original. * 

III 1^ ^ III dii ^ 3|i l# li£ 1^ ^ ^ 3tl ^ 4 iff ^ 1^ 



ERIC 



MANOVA FOR LONGITUDINAL DESIGNS WITH 
OTLTIPLE DEPENDENT VARIABLES 

by 

C, Dennis Carrell 
U.S. Of flea of Education 
and 

Robin J, HcKeown 
Univarsity of Calif o^mia* Riversida 

Longitudinal daaigna are frequetttly einplayed in aducational research and 
evaluation. Studies ineluding pre-post-ratGnCion, pdat-^ratention, ar pra--post 
tes fling ara longitudinal studies* Tha simultaneous wtiliaation of multipla 
aKparlmantal treatments or experiindnCal and control treatments in a longi-- 
tudinal study automatically yiftlds soma form of a longitudinal design* When 
iDngitudinal designs ara amployad in conjunction with multiple- dapandent 
variables j the appropriata analytic techniqua way !sa a subject for dabata. The 
.purpose of this paper' is to describe an analytic tachnique that l amoves or 
minimises the dlfficultias encountered with many of the currently advocated 
techniques* Tn addition^ an application of the proposed technique to data 
collected using materials from the Asian Studias Curriculum Project Is presented, 

CURRENT TECHNIQUES 

Techniqua I 

An analysis technique frequently advocated for longitudinal designs with 
multiple dependent variables is isultivariate analysis of variance (MANOVA) with 
covariate adjustments* For designs including pre-post-retentlon tests , sep&rate 
analyses of the post and retention tests are required following adjustmenc for 
the pretest scores* There are at least two methods of employing 
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the pretest scores as covariates* That is^ for dependent variable sec 

^1$ "^2* ^3>^ • * •i'^i* • • 
It ±a possible to covary the pretest Y^^ scores from the post test Y^ scores^ 
the preteaC Yg scores from the post test Y^ scores, the pretest Yj scores 
from the post test Y^ sccires, etc* It is also possible Co use the entire 
set (^2, through Y^^) of pretest scores as covarlates for each post teat score 
(e,g,, Y.). Finally^ the observatibns of Elashoff (1969) ^ich respect to ANOCO^A 
may be used to question these procedures. That Is^ heterogeneity of regression 
or selection bias may generate very misleading results* 

JIhm WJ^OVh with covariance adjustments technique suffers from sany problems* 
A list of these problems includes the followiriigf 

(1) Exponentiation of p^values for dasigns requiring separate analyses^ 
This problem is inherent ^ith any design including post and retention 
tests, 

^(2) The frequently required separate analyses eliminate the Gestalt froin 
the analysis. Ifii addition^ the use of separate analyses assumes some 
form of interaction (e^g,, differential trend) is present in the system. 
Interaction questions should be answered empirically , rather than by 
assumption, 

(3) The techniques of covariate adjustment are not well-defined. That is, 
with multiple dependent variables there Is no single field accepted 
technique of reducing the error wsing the covarlates » 

(4) The frequency of heterogeneity of regression in educational research 
and evaluation as well as the frequency of selection biases in educa- 
tional evaluation suggests this technique may have questionable utility 
for many problems. 



(5) No trend or dlffarantial tread analyses are Incorporated in the techniQtia, 
Concern for change, aspacially in educational evaluation^ suggests 
this techniqua Ignoras a vary Important issue. 

Technique II 

Analysis techniques fraquantly eaployad in evaluation studies are variations 
of the saparata analyals technique* This approach can take three forms, ^e first 
approach consists of separata llANOVAs for each teat occasion. That is, saparata 
analysas are conducted for tha pre-^post-- and/or retention tests* ^e major 
problemi associated with the use of this approach are (#1), C#2)p and C//5) as 
listed for Techniqua I, 

The second approach i!s to aiaploy separata univariate repeated maasures . . 
MOVAs for each dspendent variable. The problem associated with tMs technique 
is similar to the exponentiation of p^values problem* In general, the failure 
to recognise tha covarianea structura in a* dependant variable sat is the source 
of the difficulties p. The univariate p-values are accurate only when the depandent 
variables are pal^isa orthogonal. Multivariate adjustments to the F-statlstics 
lEay ba used to correct for bias in the p-values (Harris^ 1975) but these are 
rarely used* 

The third approach is to employ separate JlANOVAs for each dependent variable 
treating each test occasion observations as distinct dependent variables for the 
analyses i Profile analyses , which yield hypotheses sets slatlar to univariate 
repaated measures MOVA* are frequently employed with this technique* ^he 



problems associated with this technique ara a result of its failure tO' account 
for the covar lance structure in the dependent variable set. While this technique 
minimises the unknown difficulties with one of Che two covarianca aasumpcions of 
univariate repeated measures AJIOVA, it suffers from thai lack of p'-value adjustment 
procedures for the covarianGe structure of the dependetit; variable set* The degree 
of this problem is unkno^m, but the capitalization upon Ghande associated with 
HANOVA may Increase the degrea of the problem In relation to univariate tachn'^ques 

Technique III 

A less frequencly employed technique consists of applying HANOVA to* an 
extended dependent -variable set* That is^, the pre-post-^retention observations 
of each dependent variable are considered to be discinet dependent variables 
for the analysis* Using a pre=post-ratention design results In three times 
the originajl number of dependent variables in the extended dependent variable 
set. 

While this is the only Cechnique listed thus far that eliminates or minimlEes 
problems (tfl) , (#2)^ (if3) ^ and fff^) ^3 listed for Technique I, this technique 
(III) is not free of problems* Specifically, problem (IfS) as listed for 
Technique I Is a telling source of difficulty. In addition^ an interpretational 
problem may be experienced with this technique. That is, it Is possible for the 
l^NOVA generated composite to be a difference or sum of pretest observations of 
one dependent variable and posttest observations of another dependent variable. 
To Interpret composites of this form frequently presents a great deal of 
difficulty* * 



Proposad Tachnique 

The appropriate tachnique should take into account the following neeessary 
attributes i 

(1) The technique includes a complete hypothesis set, and thereby gives 
the analysis an appropriate Gescalt* Included in the hypothesle set 
are Issues of trend and differential trends, 

(2) The technique produces p-values after adjusting for the eovariance 
sCrueture in the dependent variable set and the covarlance structure 
in the test occasions* 

(3) The technique Is well-defined in terms of representing a single 
procedure* 

(4) Only the generaM^abillty of the results are threatened by selection 
biases. Specif icallyi the p--values reflect unbiased estimates of the 
"population" generalised from the sample employed* 

~0) The results are Interpretable In terms of the dependent variable set 
only. ^That,is,, the composites produced are not confiaunded with test 
occasions or adjustments for specific test occasions, 

tOie analytic procedure advocated by this paper is the multivariate general- 
isation of univariate repeated measures ANOVA, Simple univariate repeated 
-measures ANOVA identifies the effects and error associated with distinct groups 
of efcudents (usually referred to as "between") by summing over the Repeated facet. 
The remaining effects and error (referred to as "within") are associated with 
hypotheses concerning trends and differential trends. The multivariate general- 
isation of repeated measures AHOVA isolates the between and within terms for 
multiple dependent variables. 
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The generalization from univariate to multivariate analysis, as described 
by Harris (1975) ^ involvea 

"a search for thaC linear combination of the various outcome variables 
which makes the univariate F-ratlo Ccompuced on that single , combined 
variable) for a particular main effect or interaction as large as possible 
(page 15), 'V 

All of the variance hypotheses associated with a- univariate analysis may be 
generalised to multivariate forms by replacing the univariate dependent ; 
variable with the multivariate composite of dependent variables. That is, for., 
a longitudinal design the repeated measures hypothesis set may be retained in the : 
multivariate generalisation. This hypothesis set is complete and specifically 
includes hypotheses for trend and differential trends. In addition, the composites 
generated by the multivariate procedure are in terms of the dependent variable 
set only* 

The multivariate significance tests determine p-values that have been adjusted 
for the maximization (or capitalization upon chance) procedures employed to gener- 
ate the composites. These maximisation proeedures capitalise upon the covariance 
structure of the dependent variable set. That is, the multivariate p^values are V 
adjusted for the covariance structure of the dependent variable set. Furthermore, 
the error terms associated with repeated measures MOVA have expected values that 
are functions of the covariance structura In the teat occasions. As a result of 
this Incorporation of covariance structures for expected values, the p-values 
are appropriately estimated, Kierefore, the p-values generated by repeated 
measures HMO VA are expected to be appropriate for the covariance structures 
of the dependent variables and the test occasions. 
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As a result of tha generallised hypothesis sat associated with MANOVAs the 
technique is as well-defined as ANOVA, An added benefit la the ease of 
transition from ANOVA to MNOVA. In addition the applications of MM^OVA 
are equivalent to the applications of AKOVA (except for the multiple 
depandent variable set), . Thereforej selection biases are expected to affect 
l^OVA in the same fashion that selection biases affect AKOVA. 

Computationally s the generalization from MOVA to MANOVA la straightforward. 
The sums of squares in ANOVA are replaced by matrices of crosa-'products* 
That Iss the sums of squares for an effect A is of the form 

A leA ij j 

The generalization of SS^ to a matrix of cross products, la of the farm 

h ^ t(Y Y )CY - Y ) 

rs leA jr Ija ja 

where 

h ^ s-th element of H. 
ra A 

Y ^ the r=^th dependent varlablej and 

Y ^ the a-th dependent variable* 

s .... 

All sums of squaresj effects and errors ^ may be generalized to cross product 
matrices in this fashion. 

The F-test of ANOVA la generalized for H/^WA to a function of the greatest 

characteristic roots of H""^ H _^ . There are several MANOVA functions that 

error effect 

may be used for significance tests. The moat frequently occurring are presented 
in Morrison (1967) ^ known as Wllks' Lambda (A) , and Harris (1975), known as GCR 9, 
Harris (1975) compared these two indices and advocated GCR 9 on the basis of 
atructure and statistical power. 



M EXAOTLE: EVALUATION OF THE ASIM STUDIES CURRICUL™ PROJECT 

To Illustrate thy use of repreated maasures MANOVA, data collected Ij for 
an evaluation of materials from the Asian Studies Curriculum Projact (Michaalis, . 
1968) vera analyzed. This data reflected a condition X reading level X teat 
occasion design for siK dependent variables. 

The conditions were instructional strategies labeled as open inquiry ^ guided 
inquiry, expository » and control* The control condition was distinguished from 
the other conditions by the topic of the materials employed. The reading 
materlala in the open Inquiryi guided inquiry, and expository conditions were 
identical J but these conditions incorporated differing types of quest ions and 
directions Interspersed In the materials* The scudenta subjected to the exposi- 
tory condition were asked to respond to recall and recognition questions* 
Both the open Inquiry and guided inquiry subjects were asked to respond to 
arialysfsT^ synthesis , and evaluation questions ^ but only the guided Inquiry 
subjects were allowed to benefit from model answers* The number of questiotte 
interspersed In the materials was varied in the conditions to yield approximately 
equal raading times* 

Procedurally, the ninth grade students In twelve "regular" social studies 
claasei ware randomly assigned to condition. Five weeks, or about 25 hours, of 
instruction using the previously described condition materials was provided* 

1^/ Data were collected by Dr, Robin J* McKaown* 
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Reading level was optrat.^.onallEed by blocks of the students' California 
Achievement Test scores • Above average and below average blocks were based on 
the digtribution of the students* scores. The cut point in the distribution 
was the score associated with the 64'-th percentile , 

The test occasions weTe post and retention observations* The post-tests 
were administered within a week following completion of treatment. The retention 
tests were administered about five weeks after the post^testSi 

^e dependent variables were operatlonalized by parallel forms of experi= 
menter constructed _2/ measures. These measures were labeled as fact recall, 
concept comprehension, general synthesis skill, social problem solving, interest^ 
and Involvement, For both test occasions, the sequence of administration for 
these scales was the same as the above listing. 

The fact recall test consisted of 30 recall items. Each item required a 

response of one or two words and each item was scored as right or wrong. 

Fifteen minutes were allowed for student responses. All responses were 

associated with the material employed in the inquiry and expository conditions. 

The concept comprehension test consisted of six concepts Included in the 
inquiry and expository conditions' materials. For each concept the students 
were required to respond with a short paragraph describing and/or explaining 
the meaning of the concept. Each response was scored using a [Oj S]-scaie by 
three raters with forced agreement, 

%j The measures were constructed by Dr. Robin J, McKeown, 
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The ganaral synthesis skill test contained six sets of social studies 
materials which were unrelated to any of the experiinental inaterialst The 
respondents were required to write a brief paragraph detailing any general^ 
Igations (e*g.^ conclusions, ideas, themes) from the material, the students 
were allowed a maximum If 40 minutes to respond* Each response was scored 
using a [0, 5]^scale by three raters with forced agreement, 

Tlie social problem solving test consisted of six social value problems 
^ related to the experMental materials < Each problem required a respsni^u 
consisting of a brief paragraph analyzing the problem. The students were 
aliowed' a maxim™ of 40 minutes to respond. Each response was scored using 
a [Oi 5]"Scale by three raters with forced agreement. Only the quality of 
the analysis was scored, not the actual content. 

The interest scale consisted of 10 slx--point Likert bipolar Items in 
disagree-agree format. The stems of the Likert items were constructed to 
identify the students' interest in continuing to study about the areas covared 
in the exparimental materials. The total of the 10 itemsV scores, following 
reversal of negative scales, was used as the ihterest scale score. The internal 
consistency reliability of these total scores was estimated by Cronbach's Alpha 
to be ,90. 

The InvQlveraent scale consisted of 10 six-^polnt Likert bipolar items in 
disagree-"8gree format. The stems of the Likert Items were constructed to 
determine the degree the student wanted or wished the problems presented in the 
experimental materials to be solved. That lS| the involvement scale construe- 

■ . 11 ■ ■■. 
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tually rapresentad the studGn^Js commitmejit to a sDlutlon for tha probleTns. 
The total of the 10 items' scores/ following reversal of negative sealeSs was 
computed, A Cronbach's Alpha of •86 wa£^^ calculated as an estimate of the 
involvement scalers reliability, k 

Results ' ■ 

The descriptive indices computed from the data are displayed in Table 1# 
The data were analyzed using a 4 k 2x2 repeated measures HANC*^» The 
^^omponents evaluated using this procedure were the effects of the three 
independent variables ^ three first-order interactions , and a second-order 
interaction. Each component was associated with effect and error matrices 
that produced a maximizing linear composite of dependent variables. The 
mignitude of variation in mean composite scores associated with each effect 
was compared to chance fluctuation using greatest characteristic root (Harris^ 
1975) and Wilks* Lambda (Morrison^ 1963) criteria. Generation of effect and 
error matrices with pro^bllity indices was facilitated by a computer routine 
(Carroll and KlimowlcZj 1975). 

A condition X reading level X test occasion interactive effect was 
identified (GCR 9 ^ .175, s ^ 3, in ^ 1, n ^ 145, p < .0001; Wllks' A ^ ,775, 
F ^ 4.34, df m 18/407 j p < .OOOl). This interaction, as with ail second order 
Interactions, may be interpreted in six different ways* The source of this 
data, an evaluation of the Asian Studies Curriculum Project, indicated the 
interpretation of this " -teraction should reflect concern for the trends 
displayed by the conditions. Based upon this concern, the Interaction was 
interpreted as evidence that differences in the conditions' trends were 



dependant lipoii the subjects' feading level, A more ANOVA-^ish phrasing of this : : 
interpretation might be as follows* The condition X test occasion interactions 
are different for above and below average readers. Methodologically, the second- 
order interaction provided empirical Justification for separate analyses of the 
above average and below average subjects" data. 

Analysis for Above Average_Rej.ders_ 

The condition X test occasion: data of the above average readers were 
submitted to a 4 k 2 repeated measures MANOVA. A condition X test ocea^'lon 
Interactive effect was identified (GCR Q ^ \53B^ s ^ 3^ m ^ 1, n^. 71, p < ,0001| 
Wilks' A ^ *448, 7.45, df ^ 18/407, p < ,0001). In a fashion similar to 
that employed for the second-order interaction, the condition X test occasion { 
interaction was viewed as empirical justification for separate analyses of the ^ 
post and retention test data, 

V 

PQSt=test _analyses for above average readers 

The data were subraltted to a simple MANOVA. The mean composite scores of 
the subjects In the four conditions were different CGCR 9 = ,756, s - 3, m = 1, 
n ^ 71, p < .0001; Wilks' A ^ ,103^? ^27,91, df ^ 18/407, p < .0001), The 
composite associated with the effect of conditions was (fact recall + 2* concept 
CQmprehenslon ^ general synthesis skill). A general but tentative interpretation 
of the composite as. a discrepancy between lower and higher taxonomlc level skills 
could be posed. However , measure specific tests were also generated for theor ^ 
retical clarity. 
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Univariate analyses of the^ effects of the conditions were genarated using 
GCRF^^^^ indices (HarriSs 1975, paga 120) for significance tasting* The mean 
scores of the conditions were diffarant for all six dependant variables (face 
recalls F ^ 81, 07 1 concept comprehension, f ^111, 94; general synthesis skill, 
28*06; social problem solving, F ^ 24,58; interest, F^ 24,23 1 invQlvemen 

F ^ 27.51; in all cases df ^ 3/149 and p < .01 for F , ^9,67), In addition 

- : ... . . . -.. crit - 

to this univariate analysis, pairwisa comparisons of the mean scores of the 
conditions were conducted using Roy and Boss (1953) contrasts* The results of 
the pairwise comparisons are displayed in Table 2, 

He t an t ton _ t e s_t^ana l3r^s a a__f p r__abg^^^ average readers 

The data were submitted to a staple MANOVA, The mean composite scores of 
the conditions were different (GCR -687, s> 3^ m ^ 1^ n ^ 71, p < .0001; ; 
Wilks' .ISlj F ^ 21.52, df ^ 18/407, p < .0001). The composite associated 

with the condition's affect was (fact recall + concept comprehension^ general 
-synthesis skill). Again, a tentative interpretation of the composite as a 
discrepancy between lower and higher taxonomic level skills could be posed* 

Univariate analyses using GCRF^^^^ indices (Harris ^ 1975) indicated the 
conditions were different for all dependent variables (fact recall, F ^ 49,69; 
ceacept comprehension ^ F^ 42.94; general synthesis skill, F ^ 16.63; social ■ 
problem solving, F - 21V33; interest, F ^ 20, 67 | involvement, F>= 24.66; in 

all cases df - 3/149 and p < .01 for F . " 9.67). Pairwisa comparisons of 

. . ; . " - . crit ' 

the conditions' means were conducted using Roy and lose (1953) contrasts. The 
results of the pairwisa comparisohs are displayed in Table 3. 



Analyses for Belov Average Readers 

The condition X test Qccasion data of the below average readers ware 
gybmitted to a 4 x 2 repeated measures MANOVA. A condition X test occasion 
interactive effect was identified (GCR 9 ^ ,599* s ^ 3* ra ^1, n ^ 70.5, 
p < .0001; Wllk's A ^ ,362, F ^ 9.74, df ^ 18/405, p. < .0001). As with the 
prior interactidris, the condition X teat interaction was viewed as empirical 
justification for separate analyses of the post and retention test data. 

Post^test anL^lyses for the below average readers 

The data were submitted to a simple >^NOVA. The mean composite scores of 
the subjects in the four cianditions were different (GCR 0^ .613, s - 3, m ^ 1*: 
n ^ 70.5, p < .0001; Wilks' A ^ .266, 13.42, df ^ 18/405, p < .0001), The 
composite associated with the effect of condition was (2* fact recall^ general 
synthesis skill) . Again, the composite appeared uo be focused upon a discrepancy 
between lower and higher taxonomic level skills. 

Univariate analyses using GCR F indices (Harris, 1975) indicated the 
conditions differed on fact recall (F ^ 60,63, df ^3/148 and p < ,01 for 
F^^^^ ^ 9,68), concept comprehension (F - 28.63, df ^3/148 and p < .01 for 
F^^^^ ^9.68), and general synthesis skill (F ^ 8.67, df ^ 3/148 and p < ,05 
for F^^^^^ 7.70), For the other dependent variables, the differences in the 
conditions' mean scores failed to exceed chance eKpectation* The results of 
pairwise comparisons of the conditions^ mean fact recall^ concept comprehension, . 
and general synthesis skill scores are .displayed in Table 4, - 
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: ' Ratantion tes£ arialysas for the below averaRa readers ; . . 

- . The daCa were submittad to a simple MANOVA* The mean composite scores of ^ 

the subjects In the four conditions were different (GCR 9 - .447* s ^ 3, 1, 
n ^ 70.5, p < ,0001; Wllks' A - .400, F ^ 8,61, df ^ 18/405, p < .0001), The 
composite associated with the effect of condition was (fact recall + concept 
comprehension - general synthesis skill). Again, as with all other cases, the 
composite appeared to be focused upon a discrepancy between lower and higher 
• taxonomlc level skills. 

Univariate analyses indicated the conditions differed on fact recall and 
con^ (F^ 21.58, F ^ 20.19, respectively, with df ^ 3/148, 

p < .01 for F^p^^ ^9.68), Roy and Bose (1953) comparisons Indicated the 
control and expository groups' mean fact recall scores were different (GCR 9 
s ,200, s ^ 3, m - 1, n ^ 70,5, p < .0005), The control tnd expository groups' 
' mean concept comprehension scores were different (GCR 6 = .244, s ^ 3, 1, 
n ^ 70.5, p < .0001). Finally, comparison. of the control and guided inquiry 
groups- mean fact recall and concept comprehension scores resulted in differences 
(GCR 0 ^ ,286 and GCR 8 ^ ,216, respectively, s ^ 3, m ^ 1, n^ 70.5, p;< .0001), 

Conclusions 

The results indicated the Impact of the conditions was dependent upon the 
feading ability of the students. However, the major differences attributable to 
conditions appeared to be a discrepancy In lower and higher taKonomic level 
* skills. For the above average readers, the conditions displayed relatively long 
term effects, with the most stable differences confined to the lower level 
cognitive skills. For the below average readers, the conditions displayed 
- relatively short term effects. In fact the conditions failed to display any 

. effects on "the affective or higher level cognitive structures of the below 

=-..:■.-..-. average . readers, -V 6 ■ .- - ■ .■ ■"^^'K- 

EKLC 
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Summary • 
Tha rapaated maasuras MANOVA tachnique includas a coraprehansive, strucCured 
hypothasis set* The emptrical justification for aaparateanaly in 
the exampla. Is a major banefit not prasant with moat other taahnlques. In 
addition, the composlce acructures frequently provida tha analyst with 
serendipitous "constructs" revealing informative sourcas of the impact of 
Independent vEriablest Clearly^ this tachnique is a viable analytic tool that- 
may be applied to data that has previously resisted pristine analysis, , 

The sophistication required of the analyst using repeated measures ^^ITOVA 
,1s not vary much greater than for repaatad maasuras AN07A or higher order HANOVA* 
Indeed, r^epea ted measures MANOVA should be useful and usable for tha majority of 
educational researchers* 
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_ Table 1 

Means (X), Standard Deviations (iD) ^ and Sample Sizes (N) for 
the Condition x Reading Level x Test Oceasion Arrangeinent of 
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Post 


25,97 




12,00 


30,38 




8,69 


43.97 




6.38 


34.97 


8,86 


iiewen^xon 


^/ , 






26, 59 , 




9,56 


42.85 




6,04 


33.32 


10.91 


Below Average Readers : 
























w 




33 






37 






46 






36 r 


Faet Reoalli 
























Post :; 


2.84 




2,11 


18,68 




6.40 


15,00 




S.S9 


11,89 


4.98 


Ret jntion 


3,06 




2,37 


10,03 




5*47 


11.89 




5,55 


8.19 


5,33 


Cone ep t ; Coraprehens ion : 
























y<Jst 


3.36 




2.60 


15*51 




7.21 


12,85 




6.66 


7,86 


6.01 


■Retetltlon 


2.39 




3,oa 


10,78 




6,10 


10.15 




5,44 


5,91 


5.62 


Soalal Froblem Solving : 
























Fost 


4,39 




' 4,64 


6,14 




5.50 


7,71 




6,44 


5,39 


4.80 


Retention 


4,70 






6,03 




4.73 


6,93 




6,72 


5-11 


5.01 


General Synthesis Skill i 






\ - 


















POBt 


6,33 




5,51 


V 7,03 




4,94 


11,89 




5.87 


7.83 


5.44 


Retention 


6.42 




5.97 


5,27 




4.55 


10,07 




5.42 


6,78 


6*16. 


Interest: 
























: Post 


14.82 




11.31 


25,92 




12.08 


22.85 




12.13 


24,53 


11,82 


Retention 


18,12 




10*95 


25.10, 




13.87 


21,86 




10.75 


23,36 


11.04 


Involvement ; 
























Post 


16,91 




9,90 


23.05 




10-51 


25,52 




12,47 


20,08 


9.47 


Retention 


14,82 




11,27 


18,57 




11,75 


24,33 




13.41 


21.14 


12. 0& 



























Table 2 



Results of Roy and Bosa (1953) Comparlsone Xf of ConditlQns 
for Post--Taat. Scores of the Above Average Headers 

General Social • 
Condi tlott^2/ Faet Concept Synthesis Problem ' 

Pair Reeall Cpmprehangion Skill Solving Interest Involvement 

e - .583 9 ^ ,672 0 ^ .128 

Cj. E p < ,0001 p < .0001 n.s. n.s* P ^ »05 n.a. 

e ^ .508 9^ .560 0 ^ /227 Q ^ ,304 0 ^ .322 9 ^ .330 , 

C, GI p < .0001 p < .0001 p < ,0001 p < .OOOa p < .0001 ^p < .0001 

I 9 ^ .319 0 ^ ,424 9^ ,329 

Cj,^ 01 p < ,0001 p < ,0001 p < .0001 n, a* n.s. n.s, 

9 ^ .210 9 .220 

1, GI n.s. n.s. >^ ^ n.s, p < .0001 n.s, p .0001 

Q = .199 9 - .247 9 - .149 

01 p < .001 p < .0001 p < . 01 . n.s* n.s, n.a. 

^ . ■ , 0 ^ .122- - - 

; GIp 01 n.s, n.s.__ n.s. n*Sv_ P -05 n.s* 

IJ 3* m " 1* n - 71 for all comparisons using GCR (Harris, 1975) . 

2/ C ^ Control, E - EKposltory, GI ^ Guided Inquiry, 01 ^ Open Inquiry. 
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Tabla 3 



Results of Roy and Boss (1953) Comparisons 'U of Conditions 
for Retention Scores of Above Ayerage Readars 



General Social 
Condition %} Fact Concept Synthesis Problam 

Pair Racall Comprahengion Skill Solvins Intarast Involvemant 







9 




*460 


9 ^ 


,436 
















C 




P 


< 


.0001 


P ^ 


.0001 


n , s . 




n«s . 




n.s* 




Q,S. 






e 




,386 


8 ^ 


\335 




9 


^ ,275 


9 


^ ,288 


9 


- .225 




GI 


p 


< 


.0001 


P < 


, 0001 


n,a . 


P 


< ,0001 


P 


< .0001 


P 


< .0001 






9 




,197 


9 ^ 


.235 


9 - .161 
















01 


P 


< 


. 0005 


P < 


,0001 


p < ,005 








n.s. 






















0 


^ .180 






9 


- *277 




Gl 




n 


«s « 


n 


,s. 


n*s* 


P 


< .005 




n.s . 


P 


< ,0001 






9 




,155 






e - .214 














E, 


01 


P 


< 


,01 


n 


..s , 


p < ,0001 




n.s. 




n.sV 




n.s. 




01 




n 




n 




n . s , 




n,s. 




n.s* 




n.s. 




- 3, 


m = 1^ 


n 


^ 71 for 


all 


comparisons 


using GCR 




irria, 1975) 









^/ C ^ Controli Expositorys GI ^ Guided Inquiry, 01 - Opan Inquiry. 
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Table 4 



Rasults of Roy and Boss (1953) "Compairlsons 1^/ of 
Conditions for Post-Test Scores of Below Average Readers 

■ ^1.:' General" 

Condition 2^/ Fact Concept Bynthesia 

Pair Recall Compr ehensioja Skill 





e 




,546 


9 


- .341 




C, E 




< 


.0001 


.;::^p- 


< .0001 


n.a. 




9 




,415 


9 


^ .239 




C, GI 


P 


< 


,0001 


. P 


< .0001 


n * s * 




9 




.282 








C, 01 


P 


< 


,0001 






n.s. 


E, GI 




n 






n , s p 


n*s* 




8 




,181 


0 


M .170 




01 


: ' P 


< 


.005 


P 


< .005 


n * s . 


GI, 01 




n p a * 




n*s. 


n.s. 



1/ s =3, m = 1, n s 70,5 for all comparisons using GCR CHarrls, 1975). 
"2/ C = Control, E a Expository, Gr = Guided . Inquires 01 = Open Inquiry. 
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